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I. Introduction 

This report describes work developing fault tolerant redundant robotic architectures and adaptive control 
strategies for robotic manipulator systems which can dynamically accommodate drastic robot manipulator 
mechanism, sensor or control failures and maintain stable end-point trajectory control with minimum 
disturbance. Kinematic designs of redundant, modular, reconfigurable arms for fault tolerance were 
pursued at a fundamental level. The approach developed robotic testbeds to evaluate disturbance responses 
of fault tolerant concepts in robotic mechanisms and controllers. The development was implemented in 
various fault tolerant mechanism testbeds including duality in the joint servo motor modules, parallel and 
serial structural architectures, and dual arms. All have real-time adaptive controller technology to react to 
mechanism or controller disturbances (failures) to perform real-time reconfiguration to continue the task 
operations. The developments fall into three main areas: hardware, software, and theoretical. 


II. Hardware 

II-A. Dual Actuator 

Existing drive systems usually include motor, encoder or resolver), brake, drive train and joint bearings. 
They have no fault tolerance capability and could suffer failure through a variety of modes. To provide 
fault tolerance, one option suggested at NASA-JSC is to use multiple motors driving separate primary 
gears in a common gear box. This requires that all motors be capable of rotation at all times and any 
degradation in a motor's performance affects the joint. Another option uses dual motors driving a 
common axis through a bevel differential drive. This work suggests that such a drive system should have 
a high forward efficiency and low backdrive efficiency. Though this design can tolerate a failure of either 
motor, a failure in the differential will cripple the joint. Without complete functional duality, it is 
impossible to mask all the probable failure modes. It is, therefore, imperative that a dual actuator set 
driving a single joint be designed. 



Figure 1 . Dual-Actuator on Test-Stand 


Parameter 

Value 

torque 

800 Nm 

reduction 

30:1 

diameter 

.2 m 

length 

.3 m 

weight 

450 N 

stiffness 

10* 10 6 Nm 

power 

1.5 Hp 

Table 1. Parameters of the Dual-Actuator 


Figure 1 . shows a photograph of the actual module on its test-stand. It is symmetrical about the center line 
and has complete duality between the right and left halves. Each half contains an armature, rare earth 
magnets, resolvers, brakes and Ferguson's paradox epicyclic gear trains. The Ferguson's paradox gear 
train was chosen primarily for its high gear ratio and compactness. The module has attributes of low- 
weight, high-stiffness, minimal interfaces to the system controller, and overall compactness. The 
prototype of the module incorporates mainly off-the-shelf components compactly laic out in a 
configuration that provides low weight and high drive stiffness. Table 1. lists some of the rerformance 
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characteristics of the module. The dual sided module provides fault tolerance in the event of failure of one 
side by "doubling up" on the other side by peaking its power for a short period of time. In the event of 
seizure, the failed side has to be detached from the power train to allow the joint to turn. For the prototype 
actuator, such a detachment is necessary even in the case when the failed motor is free to move because of 
the non-backdrivability of Ferguson's paradox gear trains. Conceptually, a dual fault tolerant actuator can 
be incorporated into fault tolerance at levels II, ID, and IV. The prototype module, however, is designed 
for testing and development as a stand-alone unit and is mounted to a heavy steel test stand. 

II-B. Knuckle Fault-Tolerance Testbed 

The knuckle is designed to tolerate a minimum of 1 fault before failing. The system controller acts as a 
supervisor in analyzing the sensory feedback with a Fault Detection and Isolation (FDI) algorithm to 
determine if a fault has occurred in the knuckle. If a fault occurs at the actuator level, the motor is removed 
by disengaging a clutch. Each servo system consists of a clutch, a brushless resolver, a brake, Hall-effect 
sensors, and a three-phase Brushless DC motor. Each motor has a peak torque rating of 40 
Newton*meters and a continuous rating of 6 Newton*meters. There is a .5 meter spacing between the 
output shafts of the motors, measured along the common axis of rotation. The entire knuckle system 
weighs about 440 Newtons. Each motor is controlled by a Digital Integrated Servo Controller (DISC). 

The system controller is a personal computer operating under the Lynx O/S® real-time operating system. 



An FDI algorithm supervises the servo systems. The topic of FDI enjoys a rich history in the literature. 
Roughly twenty years ago Willsky generated a survey paper presenting a number of statistical techniques 
for fault detection in dynamic systems. Over ten years ago Isermann developed another survey paper on 
fault detection based on modeling and estimation methods. NASA also has shown considerable work in 
the area of FDI, including applications to a multi-sensor navigation system and to the space shuttle’s main 
engines. As one would hope, FDI is also important within the nuclear power industry. Singer et al. 
discuss the use of sequential statistical techniques in the analysis of the primary coolant pumping system in 
the EBR-II nuclear reactor. An expert system using pattern recognition and fuzzy inference techniques 
analyzes the statistical information to provide the fault detection. More recent work includes that of 
Visinski, et al. on fault detection thresholds based on dynamic system models. By including multiple 
redundant sensors in each servo system, as well as complete redundant servo systems, the knuckle was 
designed specifically for implementing and testing these types of algorithms. 
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In the current algorithm for the knuckle testbed, the servo control systems are assumed to be fully 
observable, deterministic, and linear time invariant. When an observable, accurate model exists, the FDI 
implementation uses parameter identification methods for detecting and, in many cases, isolating faults. 
The FDI algorithm also makes use of the currents in the EXT servo system to determine whether enough 
torque can be generated to provide the motion desired. Threshold levels are set to check for deviations 
outside of the nominal values (which are determined experimentally) and any such deviations are classified 
as faults. The algorithm also filters “false alarms” generated by transient responses or noise levels outside 
the allotted error bands. 

II-C. Digital Integrated Servo Controller fDlSCt 

The DISC is a very compact brushless DC servo controller that offers numerous features not contained in 
any single commercial system available today. Some of the features include: multiple sensor interfacing, 
compact smart power electronics, fault tolerance, and high speed digital communications designed in a 
modular package. The features incorporated into each DISC allows for research into the use of distributed 
control applied to a modular robot. Distributed control can significantly reduce the amount of wires 
running through a structure since the DISCs digitally multiplex the signals locally. This reduction in wires 
is essential to the success of modular robotics and mechanical fault tolerance. The DISC contains four 
sub-modules: a sensor interface module, a communications module, a power interface module and a digital 
controller. c 

One of the DISC’S advanced capabilities is its inherent fault tolerance. Two DISCs connect in uindem with 
two motors to actuate a single degree of freedom. In the event of a motor or sensor failure, a DISC can 
alert the system controller, and either shut itself down and allow operation to continue with only one 
motor, or try to isolate the fault and continue operation. Since a DISC uses parallel communication to talk 
to another DISC and it has control of the opposing Power Enable signal, two parallel DISCs act as a 
watchdog to each other. Thus, if a DISC were to fail, then the other DISC could detect the fault, alert the 
system controller, disable the faulty controller, disengage the clutch on the faulty controller, and continue 
operation with only one motor. 



Figure 4. Photograph of the DISC 


Propertv 

Standard 

DISC 

Wiring 

150 wires 

13 wires 

Speed 

38 KBaud 

lOMbaud 

Modularity 

none 

4 Modules 

Weight 

3 lbs. 

3 lbs. 

Pwr. Density 

15 W/in 3 

15 W/in 3 

Location 

Remote 

Collocated 


Table 2. DISC vs. Standard Practice 


Power Interface Module: The power interface controls the power to the actuator. It includes the power 
electronics and drivers, the clutch and brake control, and the current sensors. The DISC derives the motor 
commutation in software. In order to simplify the interface between the digital controller and the power 
interface, the power module uses a smart power electronic device. Smart power devices certain analog 
and/or digital circuitry in addition to the discrete power electronics. The device chosen for the DISCs 
generates the bias voltages for the high side discrete transistors as well as performing the lock rut function 
for the input PWM logic. 




5 


Sensor Interface Module: The sensor module conditions and digitizes all external signals before passing 
them to the controller module. The module will read multiple sensors, including: a tachometer (16 bit 
resolution), three current sensors ( 1 2 bit resolution), a resolver ( 16 bit resolution), a torque sensor ( 1 2 bit 
resolution), an incremental encoder (16 bit resolution), two temperature sensors (8 bit resolution), a logic 
level Hall-effect sensor, an auxiliary +/- 5V signal (8 bit resolution) and an auxiliary +/- 10V signal (8 bit 
resolution). Each of the 12 and 16 bit analog signal lines has an anti-aliasing filter with a digitally 
adjustable cut-off frequency. As a precaution, the sensor module monitors the total actuator current with 
analog circuitry and if an over-current occurs, the analog circuitry shuts the system down. 

The sensor interface module uses a five channel timing controller. Three channels function as a scheduler 
for sampling of the signals. The other two channels adjust the clock frequency of the anti-aliasing filters. 
The timer is software programmable. 

Closed-Loop Controller Module: The closed-loop controller was purchased as an off-the-shelf 

component. The module is an Advanced Micro Device’s SA-29200™ Demonstration Board. This card 
utilizes the Am29200 RISC microcontroller. The board has the following features: 512 KBytes of ROM, 
one MByte of DRAM, an RS-232 serial port, a JTAG port, two expansion connectors allowing full access 
to all processor signals, and a resident debugger. The system operates from a 5V power supply. The 
Am29200 is a 16 MHz, 32 bit integer processor with a ROM controller, a DRAM controller, an interrupt 
controller, a PIA controller, a 16 bit I/O port, a serial port, and a parallel port. 

Communications Module: The communications module controls the information between the DISCs and 
the system controller. The difficulties inherent in electrical interface design for modular robots are 
primarily a result of the high number of wires that run throughout the robot. Most robots are controlled by 
monolithic system controllers. All data is brought to the system controller using separate conductors. As 
a result, every signal, sensor, and power wire for each actuator must be run throughout the entire robot to 

the system controller. For example, a Cincinnati Milacron Inc. T 3 -776 industrial robot requires 24 wires 
for the tachometers, 54 wires for the resolvers. 1 8 wires for the brakes, 40 wires for powering the motors 
and cooling system, and 15 spare wires. This high number of wires (137) places difficult constraints on 
the design of connections within a modular robot that uses the centralized control scheme. For modular 
robots to be a viable alternative to monolithic robots the number of cables must be reduced. This can be 
achieved by using distributed control. 

Distributed control is an alternative to external, centralized control that can drastically reduce the number of 
wires required in a robot. In distributed control each actuator has its own local intelligent controller that is 
mounted either adjacent to or directly inside the actuator. The local controller performs all necessary 
sensor processing and power conversion required for movement of the particular joint. The basic 
components of a local controller would include a central processing unit, a sensor interface, a power 
interface, and a communications interface. 

The only external connections this local controller requires are for power and information. Since the local 
controller incorporates the power electronics interface, the power connections can be made to a common 
power bus that is used by all joints in the robot. Similarly, the information connections link the local 
controller to a simplified system controller through a serial digital communications bus. This 
communications bus carries all the information required to command each joint (where it should move and 
at what velocity torque). Depending on the types of power and communication buses the total number of 
wires can be less than ten. This potential drastic reduction in the number of wires required to run 
throughout a robot makes distributed control the method of choice for modular robotics. 
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III. Software 

U l*At Mult i -Criter i a Decision Making for C onfiguration Management 

This section discusses a method of redundancy resolution that uses local exploration to explicitly identify a 
set of options for the robot s motion. From this set, a decision making algorithm chooses one option as 
the next set-point command for the robot’s servo controllers. The decision making algorithm can base its 
choice on any number of performance criteria. Simulated perturbations at the joint level drive the 
exploration. Eschenbach and Tesar developed the sequential filters method of decision making and applied 
'V^nfe^ echaniSr ? sy ? tI 5? ls , Problem. They reported an example of the method reducing a design space 
ot 60,000 to one of only 50. The following discussion details the application to redundant robots. 

Perturbing the joint displacements a small amount, A <p, from their current values, <p, generates a set of 
local configuration options, <p : 

<p: <p = <p + eA<p, 

where £ is an arbitrary sweep vector with all elements equal to ±1 or 0. The vector of current 
displacement values, <p, is the base point for the perturbations. At the base point, £ = 0. All other £ with 

elements equal to combinations of ±1 and 0 generate points on the faces, edges, and vertices of an n- 
imensional hypercube with rt equal to the number of joints involved in the exploration. Figure 5. shows 
the hypercube for a robot with three degrees of redundancy. There are 2 n points on the faces of the cube, 

2 points at the vertices, and 3” points in all. Respectively, these are the simple, factorial, and exhaustive 
exploration patterns. 


The^xax.s wrist approach is a method of satisfying the placement constraints on the robot's end effector 
while also significantly increasing the speed of the optimization. Essentially, the method satisfies the End- 
EHector (EEF) placement constraints using a six-joint substructure of the robot's geometry. In essence 
the method decouples the placement constraints on the robot’s EEF from the optimization of the 
performance index. The name comes from an analogy with the three axis spherical wrist that decouples 
the rotational EEF placement constraints from the translational EEF placement constraints. 

The method acts as a filter to eliminate options not satisfying the constraints on the placement of the 
robots EEF. A series of three translations - P X ,P Y ,P Z - and three rotations - R x ,R r ,R z - will specify 
these constraints. The concatenation of the geometric transformations associated with these constraints 
generates a single transformation corresponding to the desired placement of the robot’s EEF: T. The 

concatenation of the transformations associated with the robot’s joint displacements - 0 o to '^ - and 

geometry (represented by the Denavit and Hartenberg parameters) must generate an equivalent 
transformation: ^ 


The formulation of the six-axis wrist approach proceeds as follows: 

0 rp n-5rp 

n 1 n-5 1 /i 1 ’ 

and 

n-5 rp o rp— 1 Orp 

n 1 “n-5 1 n * * 

Given the general transformation/^ 5 T, the fully-constrained reverse position solution, 0 n 5 to o n , also 
satisfies ^°T and thus Figure 6. depicts the geometry of these transformations. 



Figure 7. shows a conceptual hyper-redundant robot with 21 DOF. NASA is studying this basic 
•‘serpentine” geometry for a number of space applications where the actuators will not have to support 
gravity loads, including: astronaut assist, tool site preparation, module change-out, tile and solar panel 
inspection, and tactile manipulation. A robot with this geometry can weave through obstacle-strewn 
environments and tolerate a number of faults while maintaining a large and dexterous workspace. Figure 
8. shows a computer-generated trace of the robot following a straight EEF path. At the third frame in the 
trace, the robot experiences simulated failures in its 4th, 13th, 16th, and 18th joints simultaneously locking 
each joint. The redundancy resolution algorithm automatically reconfigures and maintains the EEF path. 



III-B. Dual-Arm Control 


Multiple arm robots represent the fourth and highest level in the fault-tolerant architecture. In the event of 
one arm failing, the extra arms could assume the task responsibilities. Fault tolerance at this level clearly 
demonstrates the need for active redundancies that provide increased capabilities as well as fault tolerance. 
The extra arms can provide additional task performance capabilities during normal operating conditions. A 
number of researchers have show n both experimental and theoretical work in cooperative manipulation 
using dual-arm robots. Notable examples include: manipulating single rigid objects single flexible objects, 
and manipulating two objects. 
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Figure 9. shows a graphic of a dual-arm robot with 17 DOF handling a thin plate. This application 
demands a balance of motion and force control representative of dual-arm operations. Multiple 
performance criteria form the basis for this balance. Figure 9. also includes the values of 5 performance 
criteria graphed against the percentage completion along the path. Figure 10. shows the actual robot 
(manufactured by the Robotics Research Corporation). 

These criteria emphasize task-based performance indicators derived from the physical description of the 
manipulator. The origins of these criteria are from foundation activity in high speed mechanisms for 
production machinery. There, the issues of precision and modeling of complex non-linear structures 
forced the development of a geometric understanding for mechanical structures and how to represent them 
with efficient analytical tools. Thomas and Tesar showed that the concept of kinematic influence 
coefficients (used in systems with 1 DOF) were effective in spatial manipulator structures with N DOF. 



IV. Theoretical 

IV-A. Performance Criteria 

Multiple performance criteria form the basis for configuration management in this work. These criteria 
emphasize task-based performance indicators derived from the physical description of the manipulator. 
The origins of these criteria are from foundation activity in high speed mechanisms for production 
machinery (Benedict and Tesar, 1978). There, the issues of precision and modeling of complex non-linear 
structures forced the development of a geometric understanding for mechanical structures and how to 
represent them with efficient analytical tools. Thomas and Tesar (1982) showed that the concept of 
kinematic influence coefficients (used in systems with 1 DOF) were effective in spatial manipulator 
structures with N DOF. An important development in this continuing work on performance criteria has 
been the association of performance criteria with the D&D tools the DAWM will use while performing its 
tasks. By choosing a tool, the operator will automatically scale and prioritize the criteria. This automatic 
process allows the use of multiple performance criteria without distracting the operator from the task at 
hand or consuming valuable time. 

The criteria formulations emphasize efficiency and portability. With currently available computational 
hardware, decisions based on several of these criteria are possible in real-time. Given the rapid pace of 
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advancements incomputational speed, it will soon be possible to employ the entire suite of performance 
criteria in a real-time decision making process. Table 3. lists the general categories of these performance 
catena. 


Table 3. General cates 

;ories of performance criteria. 

Category 

Characteristics * 

constraint criteria 

physical limitations 

geometric 

task independent 

inertial 

from dynamic models 

compliance 

design and operational issues 

kinetic energy 

content and distribution 


The constraint criteria involve rapidly calculated elementary formulauons. The robot's physical limitations 
form the basis for these criteria. These limitations restrict joint travels, joint speeds, joint accelerations, 
and joint torques. The Joint Range Availability (JRA) is representative and formulated as follows: 


JRA= I 


i=l 


^ \2 


(«;-$) 

R 2 

max 


where is the joint displacement, 6 t is the mid-range displacement and 0j max is the displacement at the 
joint limit. Throughout this report, 0, corresponds to joint displacements. The JRA measures the joint's 
displacements away from their midpoints. 


Geometric Criteria 


The Jacobian matrix forms the basis for the geometric performance criteria. Table 4. lists some of the 
geometric performance criteria. These criteria are task independent and based onlv on the geometry of the 
robot, thus these criteria are formulated once for each robot with no need for reformulation if the task 
changes (Cleary and Tesar, 1990). 


Table 4. Geometric performance criteria 

Criterion 

Symbol 

singularity detection 

% 

dexterity 

% 

velocity transmission 


force and torque transmission 


Jacobian Frobenius Norm 

Vi 

change of singularity detection criterion 

Vao 

change of dexterity criterion 

v AS 

EEF velocity-induced joint acceleration 


joint velocity-induced EEF acceleration 

Vva 


The force transmission criterion represents the magnification that the joint torques will undergo in their 
transformation to the end-effector space. As such, it may be used to indicated configurations which 
generally require smaller joint torques to fulfill the required output forces. From the principle of virtual 
work, the joint torques required to drive the robot may be transferred to the end effector as 
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T = J t F 

y 


where J is the manipulator Jacobian, F is the equivalent end-effector loads, and r is the driving joint 
torques. The singular value decomposition (SVD) may be applied to the Jacobian as: 

J = UIV T 

y 

where the orthogonal matrices U and V contain the left and right singular vectors, and L is the diagonal 
matrix containing the singular values. Substituting the Jacobian and inverting the matrix of right singular 
vector results in: 


V T r=Z T U T F 

y 

where, because V is orthogonal, its inverse equals its transpose. Taking the 2-norm (Euclidean length) of 
V T z yields: 




where r is the rank of J, and o i is J s t-th singular value. Because premultiplication by orthogonal matrices 
preserves the length of vectors, the left-hand side is simply the square of the 2-norm of the torque. Also, 

because the i-th element of U T F is a scalar, that product may be transposed and rewritten. With these 
modifications: 






where U-j is the i-th column of U . The end-effector force vector may now be decomposed into a 
magnitude, F, and direction, {J 7 }. 


r (-] 

Because the magnitude of a vector is its Euclidean length, we may conclude the development of the force 
transmission criterion, t] tx , by taking the square root of both sides and inverting as well. 


T lrX = 




(ct,{F} T U 



1 - 1/2 


Manipulator dexterity is the ability of the hand to move accurately and arbitrarily. Taken at the velocity 
level, a measure of this concept may be provided by the condition number of the manipulator Jacobian. 
The condition number is a numerical analysis tool which indicates the stability of a given transformation. 
Employed in this situation, the condition of the manipulator Jacobian indicates how error-prone the joint 
velocity vector (computed from the end-effector velocity through the inverse) will be. Perfect condition 
implies that any motion, regardless of direction, will be relatively free from numerical error. The 
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formulation of this criterion follows from the singular value decomposition of the manipulator Jacobian as 
shown above and is 


ns 


^min 

^max 


where the a’s are the minimum and maximum singular values of J. 

Inertial Criteria 


Table 5. lists some of the inertial performance criteria. These criteria have their basis in dynamic 
models of forces and torques within the robot and are essential to the intelligent design and application of 
robots. The first four criteria deal with actuator torques. The next three criteria deal with the rate of 
change of torques. The rate of change of the actuator torque criterion, , follows as: 



*(d\ 


max 


de, 


where A max is the maximum eigenvalue of the effective intertia matrix. This criterion measures how fast 
the robot can respond to torque and force demands. It is an especially important criterion because larger 
actuators or higher gear ratios can supply more torque, but both will slow the overall response of the robot 
to external disturbances. Consideration of the basic torque demands as well as its rate of change allows 
the intelligent allocation of the robot's torque resources for enhanced operation. 


Table 5, Inertial performance criteria 

Criterion 

Symbol 

dynamic coupling j]. 

actuator torque 

Hr 

equivalent EEF forces 

n v r 

EEF space actuator torque 

UjT 

change of actuator torque criterion 

n±x 

change of equivalent EEF forces criterion 


change of EEF space actuator torque crit. 


velocity-induced actuator torque 

^IvT 

velocity induced equivalent EEF force 

1 u. 

EEF velocity induced actuator torque 


GH norm 

n r 


Compliance Criteria 

Table 6. lists the compliance performance criteria. The compliance criteria describe the robot’s ability to 
perform precision operations under load. They also correspond to the vibratory modes of the robot. The 
compliance or stiffness of the manipulator is a chief concern in many tasks. When deflections are 
undesirable, the system stiffness criterion may be increased. From the generalized spring model of the 
manipulator. 
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where F is the end-effector force vector, [Jf] is the composite manipulator stiffness matrix, and A is the 
end-effector deflections. The arbitrary stiffness of the manipulator’s configuration may be determined via 
the operator 2-norm of the stiffness matrix, which is its maximum eigenvalue, or the Frobenius 
(Euclidean) matrix norm, which is the square-root of the sum of the squares of all of the eigenvalues of 
[tf]. A task-dependent criterion may also be defined in a manner similar to that of the force transmission as 
the structure of the linear equations is the same. 


Table 6. Compliance performance criteria 

Criterion 

Symbol 

oscillation 

Ha, 

system stiffness 

% 

system potential energy 

% 

potential energy partition values 



The potential energy partition values, are particularly important compliance criteria. The potential energy 
partition values measure the distribution of compliance energy and how it changes as the robot moves. An 
unusually high compliance energy content in any part of the robot indicates a problem with the robot’s 
design. Rapid changes in compliance energy indicate large local forces, which correspond to large 
actuator demands and decreased precision. 

Kinetic Energy Criteria 

Formulating the kinetic energy, KE, of a serial robot is straightforward: 

KE-}« T [i*ee]e. 

where I qq is the effective inertia matrix. This equation represents the entire kinetic energy content of the 
robot. In this formulation, the kinetic energy value depends on the joint speeds and therefore also depends 
on the task at hand. Van Doren and Tesar (1992) formulated a task-independent kinetic energy criterion. 
i) K , as: 

n ' = 'j£v- 

The A, 's are the eigenvalues of the effective inertia matrix. 

Table 7. lists some of the kinetic energy performance criteria. These criteria address high-level issues 
represented in relatively simply formulations. 


I able 7. Kinetic energy performance criteria 

Criterion 

Symbol 

joint space kinetic energy 

V, 

EEF space kinetic energy 


rate of change of joint space kinetic energy 


rate of change of EEF space kinetic energy 


kinetic energy partition values 
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The rate of change of the kinetic energy, r , is an important criterion and formulated as follows: 





dd\ 


i J 


Large changes in kinetic energy correspond to very large demands 
in the kinetic energy represent shocks to the robot. 


on actuator power. 


Very rapid changes 
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